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Analyze text and assign meaning tag to each 
syntactic unit 



Search standard sentence pattern database with 
meaning tag string as search key 



Extract phoneme strings and prosody 
information of stereotyped parts from 
standard sentence pattern database 



I 



S20 



S30 



S40 



S50 



Generate words corresponding to non- s tereotyped parts from 
language information of input text and attributes of 
non- stereotyped parts of standard sentence pattern 



Search for prosody information of non-stereotyped 
parts by use of the numbers of morae r accents , accent 
types of immediately preceding and succeeding accent 
phrases and the like 



S60 



S70 



Extract prosody information of non- stereotyped parts 
in units of accent phrases 
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Connect prosody information of stereotyped parts and 
prosody information of non- stereotyped parts by 
adjusting fundamental frequency and dynamic range 
of speech intensity 
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Alter phoneme pieces according to prosody 
information and generate speech wavef ormby 
connecting altered phoneme pieces 
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Fig. 7 (a) ^140 

1 (sharyo, vehicles) : subject] fl s (ga) [iHS (onkyo, 
sound) • # W (keikoku, warning) : object] ~& (o) [ftB^i 
(otoshutsuryoku, output- sound) : predicate] 

2 (sharyo, vehicles) : subject] # (ga) [^llj (ido, 
move) : predicate] 

3 iWM {sharyo, vehicles) : subject] & (ga) [fe® (tenkai, 
turn) • (migi, right) : predicate 1] X (te) (teishi, 
stop) : predicate 2] 

4. [A#J (jinbutsu, person) : subject] # 5 (ga) [#K) (ido, 
move) : predicate] 

5. [A^O (jinbutsu, person) : subject] & (ga) [^ff (hyojo, 
facial expression) * (^V^ (warai, laugh) : predicate 1] ?lf) % b 
(nagara) (hatsuwa, utter) : predicate 2] 

6 [A#! (jinbutsu, person) : subject] & (ga) (hyoji, 
display) : object] (o) [jiL<5 (miru, view)] 



Fig. 7 (b) r i22 



(^fSf (sharyo, vehicles) --> "a # (onkyo, sound) • # 1 
(keikoku, warning)) (e 1 !! (onkyo, sound) • Ulr (keikoku, 
warning) — » is (otoshutsuryoku, output- sound) ) 

(^pf (sharyo, vehicles) — » ^S(j (ido, move)) 2 

(^jSf (sharyo , vehicles) — > IS® (tenkai, turn) * ^t" (migi, 3 
right)) (fg® (tenkai, turn) * (migi, right) -> ffjJt (teishi, 
stop) ) 

(jinbutsu, person) -> #Sb (ido, move)) 4 

<A#7 (jinbutsu, person) — > ^fi (hyojo, facial 5 
expression) • (^cV^ (warai, laugh)) (fHflf (hyojo, facial 
expression* (^V^ (warai, laugh)) — » $feWi (hatsuwa, utter)) 

(A#7 (jinbutsu, person) — " M'F (hyoji, display)) 6 
(hyoji, display) — * ,ML<5 (miru, view)) 
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Input English speech. 
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Analyze recognition result and 
generate meaning tag 
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Search standard sentence pattern database with 
meaning tag combination as search key 



S130 



Extract prosody information of stereotyped parts and 
attributes of non- stereotyped parts from standard 
sentence pattern database 

♦ 

Generate Japanese words corresponding to 
non-stereotyped parts from attributes of non- stereotyped 
parts 

* 

Search for prosody information of non -stereo typed 
parts by use of the number of morae , accents , accent 
types of immediately preceding and succeeding accent 
phrases and the like 
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Extract prosody information of non- stereotyped parts 
in units of accent phrases 
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Connect prosody information of stereotyped parts and 
prosody information of non- stereotyped parts by 
adjusting fundamental frequency and dynamic range 
of speech intensity 

Alter phoneme pieces according to prosody information 
and generate speech wavef ormby connecting alteredphoneme 
pieces 



Output Japanese speech 
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Key word Meaning tag 

ambulance vehicles 
car vehicles 



221 



Fig. 14(a) 



1 [vehicles : subject] (ga) [sound * warning : object] 

§T (o) [output- sound : predicate] 

2 [vehicles : subject] & (ga) [move : predicate] 



^-240 

Fig. 14(b) 



( vehicles-»sound- warning ) ( sound • warning— ►output-sound ) 1 
( vehicles-»move ) 2 
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Input images |^S900 
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Recognize images 
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Generate meaning tags from recognition result 
(coordinates, time, recognition category) 
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Search standard sentence pattern database with 
meaning tag combination as search key 
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Extract phoneme strings and prosody information of 
stereotyped parts from standard sentence pattern 
database 
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IE 



Generate words corresponding to non- stereo typed 
parts from language information of input text and 
attributes of non- stereotyped parts of standard 
sentence pattern 
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Search for prosody information of non- stereotyped 
parts by use of the number of morae, accents, accent 
types of immediately preceding and succeeding accent 
phrases and the like 
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Extract prosody information of non- stereo typed parts 
in units of accent phrases 
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Connect prosody information of stereotyped parts and 
prosody information of non- stereotyped parts by 
adjusting fundamental frequency and dynamic range 
of speech intensity 
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Alter phoneme pieces according to prosody information 
and generate speech wavef ormby connecting alteredphoneme 
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Input text 
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Extract key words and assign meaning tags 



£302 
-S303 



Arrange based on relation among key words 



S304 




Output warning 



S305 
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Search standard sentence pattern database with 
meaning tag combination as search key 



Extract phoneme strings and prosody information of 
stereotyped parts from standard sentence pattern 
database 
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Generate words corresponding to non- stereotyped 
parts from language information of input text and 
attributes of non- stereotyped parts of standard 
sentence pattern 



jE 



Search for prosody information of non- stereotyped 
parts by use of the number of morae, accents, accent 
types of immediately preceding and succeeding accent 
phrases and the like 



Extract prosody information of non- stereotyped parts 
in units of accent phrases 



Connect prosody information of stereotyped parts and 
prosody information of non- stereotyped parts by 
adjusting fundamental frequency and dynamic range 
of speech intensity 



Alter phoneme pieces according to prosody information 
and generate speech wavef ormby connecting al tered 
phoneme pieces 



IE 



Output speech 
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Fig. 2 2 (a) r 14Q 

1 [Wl (sharyo, vehicles) : subject] & (ga) [W# (onkyo, 
sound) * #Hf (keikoku, warning) : object] £ (o) [Wtfrft 
(otoshutsuryoku, output-sound) : predicate 1] T (te) [#Sd <ido, 
move) : predicate 2] 

2 [j£pg (sharyo, vehicles) : subject] # (ga) (ido, 
move) : predicate] 

3 l^M (sharyo, vehicles) : subject] # 5 (ga) [Ie® (tenkai, 
turn) • (migi, right) : predicate 1] X (te) [#it (teishi, 
stop) : predicate 2] 

4 [A%9 (jinbutsu, person) : subject] & (ga) [^ifr (ido, 
move) : predicate] 

5 [A#J (jinbutsu, person) : subject] & (ga) [M^n (hyojo, 
facial expression) * ^cV" 1 (warai, laugh) : predicate 1] t£tfih 
(nagara) [^§|i§ (hatsuwa, utter) : predicate 2] 

6 [A^ (jinbutsu, person) .-subject]^ (ga) [$t7F (hyoji, 
display) : object] £r (o) [.E^ (miru, view): predicate ] 



Fig. 2 2 (b) 

r122 

(Wj (sharyo, vehicles) ~» "Ifll (onkyo, sound) • fHa 1 
(keikoku, warning)) (1 : # (onkyo, sound) • (keikoku, 
warning) -> "eB^jj (otoshutsuryoku, output-sound)) ($p| 
(sharyo, vehicles) — » (ido, move)) 

($jSj (sharyo, vehicles) ->• SI!) (ido, move)) 2 

($j^ (sharyo, vehicles) -* $s til (tenkai, turn) • ^ (migi, 3 
right)) (%zM (tenkai, turn) • £ (migi, right) -> f?ih (teishi, 
stop) ) 

(A$? (jinbutsu, person) — > (ido, move)) 4 

(A^ (jinbutsu, person) -> 5§:1# (hyojo, facial 5 
expression) • (warai , laugh)) (Hit (hyojo, facial 

expression) • (warai, laugh) -> 3§fj§ (hatsuwa, utter)) 

(A#f (jinbutsu, person) -> (hyoji, display)) (HtF 6 

(hyoji, display) -* JL<5 (miru, view)) 
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Input speech "|^S321 



Generate string of morphemes assigned key 
word flag by speech recognition 
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Search standard sentence pattern database with 
meaning tag combination as search key 



Extract phoneme strings and prosody information of 
stereotyped parts from standard sentence pattern 
database 
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Generate words corresponding to non-stereotyped 
parts from language information of input text and 
attributes of non- stereotyped parts of standard 
sentence pattern 
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Search for prosody information of non- stereotyped S308 
parts by use of the number of morae , accents , accent 
types of immediately preceding and succeeding accent 
phrases and the like 



Extract prosody information of non- stereo typed parts 
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Connect prosody information of stereotyped parts and 
prosody information of non -stereo typed parts by 
adjusting fundamental frequency and dynamic range 
of speech intensity 
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Alter phoneme pieces according to prosody information 
and generate speech wavef ormby connecting altered phoneme 
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Input text 



sio 



Analyze text and assign meaning tag to each 
syntactic unit 



Search standard sentence pattern database with 
meaning tag string as search key 
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Generate words corresponding to non- stereo typed parts 
from language information of input text and attributes 
of non- stereotyped parts of standard sentence pattern 
and generate sentence to be output as speech 
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Search for prosody pattern of each accent phrase by 
use of the number of morae , accent type r position of accent 
phrase, accent types of immediately preceding and 
succeeding accent phrases and the like and extract 
the prosody pattern 



Connect extracted prosody patterns of accent phrases 
for each corresponding meaning tag and generate prosody 
pattern of each meaning tag unit 
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Alter prosody pattern of meaning tag unit in accordance 
with prosody control information of each meaning tag unit 
stored in standard sentence pattern database 
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Connect prosody patterns of meaning tag units 
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Alter phoneme pieces according to prosody information 



and generate speech wavef ormby connecting alteredphoneme ^ 
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